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^ , Abstract 

1 -Q ' The van der Waerden number W{k, 2) is the smallest integer n such that every 

a . 2-coloring of 1 to n has a monochromatic arithmetic progression of length k. The 

existence of such an n for any k is due to van der Waerden but known upper bounds 
on W{k, 2) are enormous. Much effort was put into developing lower bounds on 
CN ■ W{k,2). Most of these lower bound proofs employ the probabilistic method often 

^ ! in combination with the Lovasz Local Lemma. While these proofs show the existence 

T-|- I of a 2-coloring that has no monochromatic arithmetic progression of length k they 

t~^ ■ provide no efficient algorithm to find such a coloring. These kind of proofs are often 

informally called nonconstructive in contrast to constructive proofs that provide an 
^O [ efficient algorithm. 

f—^ ' This paper clarifies these notions and gives definitions for deterministic- and 

randomized-constructive proofs as different types of constructive proofs. We then 
survey the literature on lower bounds on W{k, 2) in this light. We show how known 
nonconstructive lower bound proofs based on the Lovasz Local Lemma can be made 
randomized-constructive using the recent algorithms of Moser and Tardos. We also 
5^ I use a derandomization of Chandrasekaran, Goyal and Haeupler to transform these 

proofs into deterministic-constructive proofs. We provide greatly simplified and 
fully self-contained proofs and descriptions for these algorithms. 

1 Introduction 

Notation 1.1 Let [n] = {1, . . . ,n} and N+ = {1, 2, . . .}. If k e N+ then a k-AP means 
an arithmetic progression of size k, i.e., k numbers of the form {a, a + d, . . . ,a+ {k — l)d} 
with a,d e N+. 

Recall van der Waerden's theorem: 



X 



Theorem 1.2 For every k > 1 and c > 1 there exists W such that for every c- coloring 
COL : [W] — )■ [c] there exists a monochromatic k-AP, i.e. there are a,d & N+, such that 

COL{a) = COL{a + d) = ■ ■ ■ = COL{a + {k - l)d). 



Definition 1.3 Let k,c,n G N and let COL : [n] — )■ [c]. We say that COL is a {k,c)- 
proper coloring of [n] if there is no monochromatic A;-AP in [n]. We denote with W{k, c) 
the least W such that van der Waerden's theorem holds with these values of k, c and W, 
i.e., the least W such that there exists no proper coloring of [W]. 

The first proof of Theorem 11.21 was due to van der Waerden [25] . The bounds on 
W{k, c) were (to quote Graham, Rothchild, and Spencer [10]) EEEENORMOUS. Formally 
they were not primitive recursive. The proof is purely combinatorial. Shelah [23] gave 
primitive recursive bounds with a purely combinatorial proof. The best bound is due to 
Gowers [9] who used rather hard mathematics to obtain 

W{k,c)<2^^' . 

In this paper we survey lower bounds for van der Waerden numbers. Some of the 
bounds are obtained by probabilistic proofs. Since such proofs do not produce an actual 
coloring they are often called, informally, nonconstructive. However, since all of the 
objects involved are finite, one could (in principle) enumerate all of the colorings until 
one with the correct properties is found. We do not object to the term nonconstructive; 
however, we wish to clarify it. To this end we formally define two types of constructive 
proofs. We only define these notions for proofs of lower bounds on W{k, c). It would be 
easy to define constructive proofs in general; however, we want to keep our presentation 
simple and focused. 

Definition 1.4 A proof that W{k,c) > f{k,c) is deterministic- constructive ii it presents 
an algorithm that will, for all k, c, produce a proper c-coloring of [f{k, c)] in time poly- 
nomial in f{k,c). 

Some of the nonconstructive techniques yield a randomized algorithm that, with high 
probability, will produce a proper coloring in polynomial time. These seem to us to be 
different from truly nonconstructive techniques. Hence we define a notion of randomized- 
constructive. 

Definition 1.5 A proof that W{k,c) > f{k,c) is randomized- constructive if it presents 
a randomized algorithm that will, for all k, c, 

• always produce either a proper c-coloring or the statement I HAVE FAILED!, 

• with probability > 2/3 produce a proper c-coloring, and 

• terminate in time polynomial in f{k,c). 



Note 1.6 

1. The success probability can be increased through standard amphfication by repeat- 
ing the algorithm (say) f{k,c) times to make the probability of success 1 — ^(Xtj 
or even higher. The required explicitly declared one-sided error makes it further- 
more possible to transform each randomized-constructive proof into a Las Vegas 
algorithm that always outputs a proper c-coloring in expected polynomial time. 



Similar probabilistic proofs of lower bounds for (off-diagonal) Ramsey Numbers [101 
ITT] are neither deterministic-constructive nor randomized-constructive. The reason 
for this is that no polynomial time algorithm for detecting a failure (i.e., finding 
a large clique or independent set) is known. This makes randomized algorithms 
such as the ones by Haeupler, Saha, and Srinivasan [11] inherently Monte Carlo 
algorithms that cannot be made randomized-constructive. 



3. Work of Wigderson et al. [131 IE] on derandomization shows that, under widely 
believed but elusive to prove hardness assumptions, randomness does not help al- 
gorithmically - or more formally that P = BPP. In this case the above two notions 
of randomized-constructive and deterministic-constructive would coincide. 

We present the following lower bounds: 

1. W{k,2) > w|2('^^^^/^ by a randomized-constructive proof. This is an easy and 

known application of the probabilistic method of Erdos and Rado [6] . This result is 
usually presented as being nonconstructive. 

2. W{k, 2) > \/k2^^~^'''^ by a deterministic-constructive proof. This is an easy deran- 
domization of the Erdos- Rado lower bound using the method of conditional expec- 
tations of Erdos and Selfridge [7]. It is likely known though we have never seen it 
stated. 

3. If p is prime then W{j) +1,2) > j)(7P — 1) by a deterministic-constructive proof. 
Berlekamp [3] proved this; however, our presentation follows that of Graham et 
al [TU]. Berlekamp actually proved iy(p + 1,2) > p2^. He also has lower bounds 
if /c is a prime power and c is any number. Using a hard result from number 
theory [Ij we obtain as a corollary that, for all but a finite number of A;, Wik^ 2) > 

4. Vr(A;,2) > ^-^^ by a randomized-constructive proof. The nonconstructive version of 
this bound is implied by the Lovasz Local Lemma [5] and by Szabo's result [23] (ex- 
plained below). The randomized-constructive proof is an application of Moser's [T7] 
algorithmic proof of the Lovasz Local Lemma. Our presentation is based on Moser's 
STOC presentation [16] in which he sketched a Kolmogorov complexity based proof 
that differed significantly from the conference paper [17]. Later Moser and Tardos 
wrote a sequel making the general Lovasz Local Lemma (with the optimal constants) 



constructive [18]. Schweitzer had, independently, used Kolmogorov complexity to 
obtain lower bounds on W{k, c) 



5. For all e > 0, for all k G N+, W{k,2) > - — ^ — - by a deterministic-constructive 
proof. More precisely we give a deterministic algorithm that, given k and e, al- 
ways outputs a proper coloring of [- — ^ — —] in time 2'^^^^'^^ which is polynomial in 
the output size for any constant e > 0. This result is an application of a deran- 
domization of the Moser-Tardos algorithm for the Lovasz Local Lemma given by 
Chandrasekaran, Goyal and B. Haeupler [1]. We present a simplified, short and 
completely self-contained proof. 

6. The Lovasz Local Lemma algorithm by Moser and Tardos [,18j can be used to ob- 

o(fc — 1) 

tain W{k, 2) > ^^ by a randomized-constructive proof matching the best non- 
constructive bound directly achievable via the Lovasz Local Lemma (see [10]). We 

show W{k, 2) > —^ 1 as a simple corollary of our deterministic-constructive 

proof. 



Note 1.7 

1. The best known (asymptotic) lower bound on W{k,2) is due to Szabo 

Ve>0, V large fc: W{k,2) > — . 

k" 

The proof is involved, relies on the Lovasz Local Lemma and additionally exploits 
the structure of fc-APs that almost all k-AP are almost disjoint (i.e., intersect in 
at most one number). While the original proof is nonconstructive it can be made 
constructive using the methods of some recent papers [H [HI [T8] . 

2. There is no analog of Szabo's bound for c > 3 colors known. In contrast to this the 
techniques presented here directly extend to give lower bounds on multi-color van 

(k~~l) 

der Waerden numbers of the form W{k,c) > '^ ^^ for any integer c > 2. 

3. The techniques used to prove the results mentioned in items 1,2,3,5, and 6 can 
be modified to get lower bounds for variants of van der Waerden numbers such as 
Gallai-Witt numbers (multi-dimensional van der Warden Numbers) f2U[ f2T\ (see also 
[8l[T0]), and some polynomial van der Waerden numbers [21 [26] (see also [8]). 

We use the following easy lemmas throughout the paper. 

Lemma 1.8 Let k,n E N+. 

1. Given a k-AP of [n] the number of k-AP's that intersect it is less than kn. 

2. The number of k-AP's of [n] is less than n^/k. 



Proof: 

1.) We first bound how many /c-AP's contain a fixed number x G \n\. Let 1 <i <k. If x 
is the i^^ element of some k-KP then in order for this fc-AP to be contained in [n] its step 
width d has to obey: 1 < x — {i — l)d and x + {k — i)d < n. 

We assume for simphcity that k is even (the odd case is nearly identical). Once i and 
d are fixed, the fc-AP is determined. We sum over all possibilities of i while assuming 
the second bound on d for all i < kjl and the first bound for % > k/2. This gives us the 
following upper bound on the number of fc-APs going through a fixed x: 

fc/2 k . k/2 fc 1 

1 r + > -■ T = (n-x)} : + x - 1 > = 

i=l i=A;/2+l i=l i=fc/2+l 

k 



(n — X + X — 1) y 

^-^ % — \ 



< n-\. 



i=k/2+l 



Here the last inequality follows from Yli=k/2 J^ — ^ which can be easily shown by 
induction. Using this upper bound we get that the number of fc-AP's that intersect a 
given k-AP is at most k{n — 1) < kn. 

2.) If a k-KP has starting point a then then a+ {k — l)d < n, so d < |5f • Hence, for any 
a G [n], there are at most |5i ^-AP's that start with a. The total number of fc-AP's in 
[n] is thus bounded by 



ji-l -, n-l / -, X 2 

En — a 1 ^^ n{n — l) n 

fc3T = :fc3TZ^^-«= 2(k-l) ^J 



a=l a=l 



2 A Simple Randomized-Constructive Lower Bound 

Theorem 2.1 W{k,2) > ./ ^2^^~^^^'^ by a randomized- constructive proof. 



Proof: We first present the classic nonconstructive proof and then show how to make 
it into a randomized-constructive proof. 

Let n = 1 /|/c2'^'^'^^/^. Color each number x from 1 to n by flipping a fair coin. If the 
coin is heads then color x with 0, if the coin is tails then color x with 1. Let p be the 
probability that there is a monochromatic k-AP. We will show that p < 1 and hence there 
is some choice of coin flips that leads to a proper 2-coloring of [n]. 

By Lemma 11.81 the number of fc-AP's is bounded by n'^/k. Because of the random 
choice of colors each k-AP becomes monochromatic with probability exactly 2"*^'^"^^ and 
a simple union bound over all /c-AP's gives: 



P < {n''/k)2-^^-^^ 



n^ 



^2(fc-i)- 

Looking ahead to making this proof randomized-constructive we want this probabihty 
to be at most 1/3. We show that this is imphed by our choice of n. 
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k2^ ^ '" 

We now present a randomized algorithm that produces (with high probabihty) a proper 
coloring and admits its failure when it does not. 



1. Get input k and let n = J\2^^-^^'^. 

2. Use n random bits to color [n]. 

3. Check all /i;-APs of [n] to see if any are monochromatic, (by Lemma 11.81 there 
are at most n"^ /k different fc-APs to check, so this takes 0{n'^) time). If none are 
monochromatic then the coloring is proper and we output it. Else output I HAVE 
FAILED!. 

By the above calculations the probability of success is > 2/3. By comments made in 
the algorithm it runs in polynomial time. | 

3 A Simple Deterministic-Constructive Proof 

Theorem 3.1 W{k,2) > yk2^'^~^^/'^ by a deterministic- constructive proof. 

Proof: We derandomize the algorithm from Section |2] using the method of conditional 
probabilities [5]. Let n < a/A;2*^'^~^^/^ and X be the set of all arithmetic progressions of 
length k that are contained in [n]. 
Let / : R" -^ R be defined by 

f{Xi,...,Xn) = "^(Ylxi + Y[{'^ - Xi)). 



We will color [n] with O's and I's. Assume we have such a coloring and that Xj is 
the color of i. When Xi is set to 1/2 that means that we have not colored it yet. Note 
that f{xi,...,Xn) gives exactly the expected number of monochromatic fc-AP's when 
each number i gets colored independently with probability P{i is colored 1) = Xj. Thus 
a coloring has a monochromatic /c-AP iff /(xi, . . . ,a;„) > 1. We will color [n] such that 
/(xi,...,x„) < 1. 

Note that 

/(1/2, . . . , 1/2) = E.ex(n.e. 1/2 + n... 1/2) = E..x((V2)'^ + (1/2)^) 

= E..x(i/2)^-^ 

We need this to be < 1. We set this < 1 which will derive what n has to be. 

nV(A;2'=-i) < 1 

n< y^2('=-^)/2 
We now present a deterministic algorithm: 

1. Let Xi = X2 = ■ ■ ■ = Xn = 1/2. By Lemma [1.81 the number of fc-AP's is < n^ /k. By 
the above calculation /(xi, . . . , x„) < 1. 

2. For z = 1 to n do the following. When we color i we already have 1, 2, . . . , i — 1 
colored. Let the colors be ci, . . . , Cj_i. Hence our function now looks like, leaving 
the color of z a variable, /(ci, . . . , Cj_i, z, 1/2, . . . , 1/2). This is a linear function of 
z. We know inductively that if z = 1/2 then the value is < 1. If the coefficient of z 
is positive then color i 0. If the coefficient of z is negative then color z 1. In either 
case this will ensure that 

/(ci, . . . , Q, 1/2, . . . , 1/2) < /(ci, . . . , Ci_i, 1/2, . . . , 1/2) < 1. 

At the end we have /(xi, . . . ,Xn) < 1 and hence we have a proper 2-coloring. It is 
easy to see that this algorithms runs in time polynomial in n. | 



4 An Algebraic Lower Bound 

We will need the following facts. 

Fact 4.1 Let p G N (not necessarily a prime). 

1. There is a unique (up to isomorphism) finite field of size 7P . We denote this field by 
F2P. F2P can be represented by F2[x]/ < i{x) > where i is an irreducible polynomial 
of degree p in F2[x]. F2P can be viewed as a vector space of dimension p over F2. 
The basis of this vectors space is (the equivalence classes of) l,x, x^, . . . ,x^~^. 



2. The group F2P — {0} under multiplication is isomorphic to the cyclic group on 2^ — 1 
elements. Hence it has a generator g such that 

F,.~{0} = {g,g^g^...,g''-'}. 

This generator can be found in time polynomial in 7P . 

3. Assume p is prime. Let g be a generator of F2P, and (i = g'^ where 1 < d < 2^ — 1. 
We do all arithmetic in F2P. Let P be a nonzero polynomial of degree < p — I, with 
coefficients in {0, 1, 2, . . . , 2^ - 1}. Then P{g) ^ and P{l3) ^ 0. 

Proof: The first two facts are well known and hence we omit the proof. To see the 
third fact note that F2P can be viewed as a vector space of dimension p over F2. There 
can be no field strictly between F2 and F2P: if there was then its dimension as a vector 
space over F2 would be a proper divisor of p. For any a e F2P — F2 we get now that 
F2{a) is F2P because it would otherwise be a field strictly between F2 and F2P. Hence the 
minimal polynomial of a in -F2[X], which we denote Q, has degree p. Let P be a nonzero 
polynomial in -F2[-^] of degree at most p — 1. If P(a) = then P has to be a multiple of 
Q. Since P has degree < p — 1 and Q has degree p, this is impossible. Hence P{a) 7^ 0. 
This applies to a = g and to a = g'^ with 1 < d < 2^ — 2. (Note that d = 2^ — 1 gives 
/3 = 1.) I 

Theorem 4.2 If p is prime then W{p+ 1, 2) > p{2^ — 1) by a deterministic- constructive 
proof. 

Proof: Let F = F2P, the field on 2^ elements. By Fact [T] F is a vector space of 
dimension p over F2. Let vi, . . . ,Vphe a. basis. By Fact |2] there exists a generator g such 
that 

F-{0} = {g,g\g^...,g'''-'}. 

We express g,g'^, . . . , f?^*""^, g'^'' , . . . , gP'^'^^"^^ in terms of the basis. This looks odd since 
g = g'^^ so this list repeats itself; however, it will be useful. 

For 1 < j < p{2'P — 1) and for 1 < i <p\et aij G {0, 1} be such that 



dijVi. 



9' = E' 

We now color [p(2^ — 1)]. Let j G [^(2^ — 1)]. Color j with a^. That is, express g^ in 
the basis {vi, . . . ,Vp} and color it with the coefficient of vi, which will be a or 1. We 
need to show that this is indeed a proper coloring. Assume, by way of contradiction that 
the coloring is not proper. Hence there is a monochromatic {p + 1)-AP. We denote it 

a,a + d, . . . ,a + pd. 

Since all of the numbers are in [^(2^ — 1)] we have a+pd < ^(2^ — 1) and thus d < 2^ — 2. 
Therefore we get g'^ ^ 1. 



If we express any of 

/ = {9\ 9"^", • • • , ^'^+"'} = {9\ 9^9^ 9''9'\ • • • , ^ V} 

in terms of the basis they have the same coefficient for v\ . Let a = g"" and P = g'^ ^ 1. 
Recall that, by Fact [3l /3 does not solve any degree p — 1 polynomial with coefficients in 
{0,1}. 

Case 1: The coefficient is 0. Then we have that all of the elements of / lie in the p — 1 
dim space spanned by {v2, ■ ■ ■ ,Vp}. There are p + 1 elements of /, so any p of them are 
linearly dependent. Hence I' = {a, a/3, a/3^, . . . , a/?^"^} is linearly dependent. So there 
exists bo, ... , bp-i G {0, 1}, not all 0, such that 

p-i 

1=0 

Therefore P satisfies a polynomial of degree < p — 1 with coefficients in {0,1}, contra- 
dicting Fact [31 

Case 2: The coefficient is 1. Hence all of the elements of J, when expressed in the basis 
{f 1, . . . , Vp} have coefficient 1 for vi. Take all of the elements of I (except a) and subtract 
a from them. The set we obtain is 

{a/3 - a, a/32 - a, ... , ^^p _ ^} = {^(^ _ x)^ ^^^2 _ 1)^ . . . ^ ^{(3" - 1)}. 

KEY: All of these elements, when expressed in the basis, have coefficient for Vi. Hence 
we have p elements in a p — 1-dim vectors space. Therefore they are linearly dependent. 
So there exists bo, ... , 6p_i G {0, 1}, not all 0, such that 

p-i 

^6,a(/3*-l) = 

1=0 

p-i 
J]6,(/3^-l)=0. 

j=0 

Therefore /3 satisfies a polynomial of degree < p — I over F2. This contradicts Fact |3l 
We now express the above proof in terms of a deterministic construction. 

1. Input(j9 + 1). 

2. Find an irreducible polynomial i{x) of degree p over -F2[x]. This gives a represen- 
tation of F2P, namely F2[x]/ < i{x) >. Note that 1, x, x"^, . . . , x^~^ is a basis for F2P 
over F2. Let Vi = x^^^. 



3. Find g, a generator for F2P viewed as a cyclic group. 

4. Express g, g"^, . . ., (^^(^p-i) j^ ^gj^^g of the basis. For 1 < j < p(2^ — 1), for I < i < p 
let ttij G {0, 1} be such that g^ = ^f^j^ ciijVi. 

5. Let j G [p{2P - 1)]. Color j with aij. 

Steps 2 and 3 can be done in time polynomial in 2^ by Fact 14.11 Step 4 can be done in 
time polynomial in 2^ using simple linear algebra. Hence the entire algorithm takes time 
polynomial in 2^. | 

Baker, Harman, and Pintz [I] (see |T5j for a survey) showed that, for all but a finite 
number of k, there is a prime between k and k — A;°-^^^. Hence we have the following 
corollary. 

Corollary 4.3 For all but a finite number of k, 

(We do not claim this proof is deterministic- constructive or randomized- constructive. ) 

Proof: Given k let p be the primes such that k — /c^-^^s < p < k. By Theorem 14.21 
W{p + 1, 2) > p{2P - 1) Hence 

W{k, 2) > W{p + 1, 2) > p{2P - 1) > (A; - k''-'^^)(2^-k°-''' _ 1). 



5 A Bit of Kolmogorov Theory 

We will need some Kolmogorov theory for the next section and thus give a short intro- 
duction here. For a fuller and more rigorous account of Kolmogorov Theory see the book 
by Li and Vitanyi [T5] . 

What makes a string random? Consider the string a; = 0". This string does not seem 
that random but how can we pin that down? Note that x is of length n but can be easily 
produced by a program of length lg{n) + 0(1) like this: 
FOR a; = 1 to n, PRINT(O) 

By contrast consider the following string 

X = 0110100101010010101011111100001110010101 

which we obtained by flipping a coin 40 times. It can be produced by the following 
program. 

PRINT(OllOlOOlOlOlOOlOlOlOllllllOOOOlllOOlOlOl) 

10 



Note that this program is of length roughly |x|. There does not seem to be a shorter 
program to produce x. The string x seems random in that there is no pattern in x which 
would lead to a shorter program to print x than the one above. Informally a string x 
looks random, if the shortest program to print out x has length roughly |x|. We formalize 
this. 

Definition 5.1 Fix a programming language L that is Turing complete. Let x G {0, 1}" 
(think of n as large) and y G {0, 1}™" (think of m as small). KL{x\y) is the length of the 
shortest program P in L such that P{y) has output x. 



Fact 5.2 If Li and L2 are Turing complete programming languages then there is a pro- 
gram that translates one to the other. This program is of constant size. Hence there is a 
constant a G N such that \KLj^{x\y) — KL,^{x\y)\ < a. Therefore KL{x\y) is independent 
of L up to an additive constant factor. Hence we will drop the L and always include an 
0(1) or Q{1) term as is appropriate. 



Definition 5.3 A string x is Kolmogorov random relative to y if K{x\y) > \x\ + f2(l). 

Fact 5.4 By comparing the number of strings of length n to the number of descriptions 
of length smaller than n we conclude that most strings are Kolmogorov random. Hence 
if you find that a randomized algorithm works well when you use a Kolmogorov random 
string for the random bits, then it works well for most strings. We will assume that at 
least 2/3 of all strings of length n are Kolmogorov random; however, there are really far 
more. 

6 A Randomized-Constructive Lower Bound via the 
Lovasz Local Lemma 

We use the following lemma both in this section and the next section. The bulk of this 
lemma is an exercise from Knuth [2]; however, we include the proof for completeness. 



Lemma 6.1 Let m G N and T, Ti, . . . ,Tm be infinite rooted trees with each node having 
exactly x ordered children. 

1. There are at most {^^^ < {exY subtrees of T that include the root and consist of 
exactly s non-root nodes. 

2. Let T be the set of all forests F consisting of at most m trees, such that each tree 
is a subtree of a different Ti, and such that the total number of nodes in F is s. T 
consists of at most T^{exY forests. 
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Proof: 

1.) Given a subtree of T with s non-root nodes, record an ordered DFS traversal using a 
zero to denote that a potential child is not there and a one for every forward step along 
an existing child. Stop the traversal at the last non-root node without recording zeros for 
its children. There are x (potential) children each for both the root and each but the last 
of the s non-root nodes; each of these sx children appears at most once in the traversal. 
Therefore a string of length at most sx is recorded. The string has furthermore exactly s 
ones, one for each non-root node. Note that any two different subtrees of T correspond 
to two different strings. We thus have an injection from the specified subtrees into the 
set of zero-one strings of length at most xs with exactly s ones. There are exactly (^^) 
such strings and therefore also at most this many subtrees of T with s non-root nodes. 
The inequality (^^) < (xe)^ follows from Stirling's formula. 

2.) Let T' be the ordered tree that has a root r of degree m and at the i*^ child of r 
attached Tj (so the i^^ node on the second level is the root of Tj). There is a straight 
forward bijection between forests in J-" and subtrees of T' with s non-root nodes. 

We describe such a subtree of T' by a subset of [m] to specify the children of r that are 
not used and by a zero-one string of length at most xs with exactly s ones corresponding 
to a DFS-traversal of the remaining tree in the same manner as above. Each forest in J-" 
can be uniquely described in such a manner (but not all those descriptions correspond to 
a valid tree). The total number of those descriptions and therefore also the total number 
of forests in J-" is at most 2™(a;e)*. | 

of fc — 1) 

Theorem 6.2 W{k,2) > ^^ by a randomized- constructive proof. 

Proof: Let n = ^ ^^ . We present a randomized algorithm to find a 2-coloring of 
[n]. Let El, . . . ,Ejn be the fc-AP's of [n] listed in lexicographic order. By Lemma 11.8^ 
m = 0{n'^/k). 

We present a simple algorithm with a parameter s, which we will determine later. 
MAIN ALGORITHM 

1. Color [n] using n random bits 

2. NUM CALLS = (this will be the number of calls to FIX). 

3. For i = 1 to m ii Ei is monochromatic then FIX{E.j). 

4. Output the coloring. 

END OF MAIN ALGORITHM 
FIX ALGORITHM 

FIX{E) 

1. NUMCALLS = NUMCALLS + 1. 
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2. If NUM CALLS = s then STOP and output I HAVE FAILED. 

3. Recolor E randomly (this takes k random bits). 

4. While there exists a monochromatic fc-AP that intersects E let E' be the lexico- 
graphic smallest such k-AP and call FIX{E'). 

END OF FIX ALGORITHM 

We leave the following easy claims to the reader: 
Claim 1: For all calls to FIX that terminate the following holds: all of the fc-AP's that 
were not monochromatic before the call are not monochromatic after the call. 
Claim 2: If the algorithm outputs a coloring then it is a proper coloring. 

We find a value for the parameter s such that s is polynomial in n and k and such that 
the probability of the algorithm's success is at least 2/3. With parameter s the algorithm 
uses at most n + sk random bits. We can think of the algorithm as a deterministic one 
which takes an additional n + sk bit string as input to use in place of the random bits. Let 
z = zqZi ■ ■ ■ Zg denote that string. The first n bits are used for the initial color assignment, 
and the remaining bits are used for the reassignments as needed. 

Let z = zqZi ■ ■ ■ Zg he a Kolmogorov random string relative to k, n. We will show that 
if the algorithm is run with z supplying the random bits then the result will be a proper 
coloring of [n]. Since over 2/3 of all strings of length n + sk are Kolmogorov random 
relative to k, n this will prove that the algorithm succeeds with probability > 2/3. 

Assume, by way of contradiction, that the algorithm goes through s calls to FIX. We 
will pick a value of s so that this leads to a contradiction. 

Definition 6.3 The FIX-FOREST is the forest of calls to FIX. We take the children 
of a node to be ordered in the same order the procedure FIX was called. The nodes are 
labeled by what monochromatic k-KP they were called with and what color (a bit) the 
fc-AP was before the call. 



Definition 6.4 For 1 < i < ?7i we define a tree Tj as follows. 

• The root is labeled with Ei (the i^^ k-KP in lexicographic order). 

• If a node is labeled with a k-KP E then the children are the fc-AP's that intersect 
E in lexicographic order. 

Putting all this together we get: 

Fact 6.5 

L By Lemma ll.Si every node of Ti has at most kn children. 
2. By Claim 1 the FIX-FOREST has less than n^/k trees 
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3. All trees in the forest are subtrees of different subtrees Ti. 

This makes it possible to apply Lemma 16.11 and obtain that the number of different 

FIX-FOREST structures is at most 2~{kn)^. From this we get that, given n and k, each 
FIX-FOREST can be described by ^ + s\g{kn) +0(1) bits for its structure and another 
s bits for the color labels. Now let w be the coloring after s calls to FIX are performed. 
Note that w can be described with n bits. The next claim shows that taking all these 
descriptions it is possible to reconstruct the Kolmogorov random string z. 

Claim 3: Given n, k the FIX FOREST and w one can recover z. 
Proof of Claim 3 

From the FIX FOREST we can obtain: 

• a description of the A;-AP Oj that the i^^ call was made on. 

• the color & of a,- when the i^^ call to FIX was made. 
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We recover the z's in three phases. 

Phase I (just use the Oj's but not the Cj's): Simulate the Coloring Algorithm using 
the symbols zj where {0 < i < s, ii i = 1 then 1 < j < n, if z > 2 then 1 < j < A;) to 
represent the jth bit of Zi. Note that we do not know the actual colors so we really do 
use (say) z| and not RED (or more formally or 1). Since we have a^ we can (and do) 
keep track of the coloring of [n] after each call to FIX, in terms of the symbols z^. This 
creates a table of z^^s. 

For example, if n = 15 then the first row will be: 

1 II ^1 I ^2 I ^3 I ^4 I ^5 I ^6 I ^7 I ^8 I ^9 I ^10 | ^11 | ^12 | ^13 | ^14 | ^15 | 
-"- II ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I ^0 I 

If fc = 4 ai = (4,7,10,13), i.e., the first call to FIX was to (4,7,10,13), then the 
second row will be 

9 II ^1 I ^2 I ^3 I ^1 I ^5 I ^6 I ^2 I ^8 I ^9 I ^3 I ^11 | ^12 | ^4 | ^14 | ^15 | 
■^ II ^0 I ^0 I ^0 I ^1 I ^0 I ^0 I ^1 I ^0 I ^0 I ^1 I ^0 I ^0 I ^1 I ^0 I ^0 I 

Phase II (use the Cj's to determine zj^s): For all 1 < i < s, right before the i^^ call to 
FIX, k-AP tti was monochromatic; all k vertices of Oj were colored Cj. For 1 < j <i — 1 
let Vj be the vertices of Oj that were most recently colored by Zj (note that Vj could be 
empty). By Phase I we know which bits of Zj colored which vertices of Vj. We now know 
that those bits are Cj. For each i we have recovered k bits of z. Since there are s calls to 
FIX this phase recovers sk bits. 

Phase III (use w): For each x G [n] there is an i,j so that x was colored zl and never 
recolored. We now know the zl = w^. This phase recovers n bits of z. 

The phases all together recover n + sk bits of z. Since \z\ = n + s/c all of z is recovered. 
End of Proof of Claim 3 
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By Claim 3, z can be described using n, k the FIX FOREST and w. Since w can be 
described by n bits and since Fact 16.51 4 tells us that the FIX FOREST can be described 
with s + ^ + slg(/i;n) + 0(l) bits we get a description oiz of size s + ^ + slg(fcn) + 0(l)+n. 

On the other hand we assumed z to be Kolmogorov random relative to fc, n which 
implies that any description of z has to have length at least n + s/c + 0(1). Hence 

nr 
s + - — V s lg(A;n) + 0(1) + n > n + sfc 
k 

— + 0(1) >sk-s-s \gikn) 
k 

— + 0(1) 
s< , \^yl . <nyP + 0{l) 

k — 1 — [g[kn) 
Now choosing s > p- + 0(1) leads to the desired contradiction. | 



7 A Deterministic-Constructive Lower Bound by 
Derandomizing the Lovasz Local Lemma 

Theorem 7.1 Fix e > 0. W{k,2) > - — ^ — - by a deterministic-constructive proof. 

Proof: Let n = - — ^ — -. (We assume n is an integer; the modifications to make 
this rigorous are easy but cumbersome.) We will present a deterministic algorithm that 
always produces a proper 2-coloring of [n] and runs in time n^^^ ^ which is polynomial 
as long as e is any fixed constant. The algorithm proceeds in stages. 
Let t be a parameter to be named later. It will be 0(e~^'°^). 

Stage 1: List out Trees 

We create by exhaustive enumeration a list of the following set of trees Y: 
For each k-AP E, for each subset S of E, take all possible labeled trees that satisfy the 
following properties: 

1. the root is labeled with S, 

2. each non-root node is labeled with a k-AP of [n], 

3. the labels of each child of a node B share a number with the label of B, 

4. the labels of nodes on the same level are disjoint, 

5. there are between t and 2t non-root nodes. 
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EXAMPLE: A few trees in Y for n=7,k=3,t=l .5 

23 246 35 

I I I \ 

234 567 123 567 
I 

23 135 
I 

357 34 4 
I \ I 

3 123 456 147 

I I 

123 14 357 

I I \ 

123 135 246 



To bound the running time of this and the next stage we need to check that the number 
of trees in Y is always polynomial in n. For this recall that by Lemma 11.81 there are at 
most n^/k different fc-AP's which gives us at most 2'^n'^/k possible roots. If the root is 
fixed then by property [3] and again Lemma 11.81 we know that each tree in y is a subtree 
of the infinite tree in which each k-AP has as children the < nk k-APs it intersects with. 
Using Lemma 16.11 2 with x = kn and s = t we obtain that there are at most 

(nke)^' 

such subtrees of size 2t. Therefore the total number of trees \Y\ is at most 



fc^2 



2'^n 



inkeft < n^ ■ {n^'n < n^W = n'^^^ °) 



k 
Hence this stage of the algorithm runs in polynomial time for any fixed constant e > 0. 

Stage 2: Creation of a good table 

Similar to the proof of Theorem 16.21 we create a table with a sequence of colors for 
every number. A table is a map T : [n] x [t] — )► {0, 1} in which we view each row as a 
sequence of colors for its (column)-number. We will be looking at colorings of the numbers 
on the nodes of the tree that is guided by a table T. T{x, t) will tell us how to color the 
number x the t*'* time we look for a color of x when we process the tree level-by-level 
from leaf-to- root. More formally we assign each number x in the label of a node v E r 
the color 

T{x, 1 + number of nodes below v whose label contain x). 

Given a tree r and a coloring of its numbers guided by table T say r is consistent with T 
iff all labels of r are colored monochromatically. 



16 



Note that because of property H] each color in the table T gets used only once during 
this process. Thus if all colors in T are chosen independently at random each label of a 
node gets monochromatic independently with probability 2~('^~^). The probability for a 
tree in Y to be consistent is thus at most 2~('^~^)* where i is the number of non-root nodes. 
Having this and computing {^2^{nkey) as an upper bound for the number of trees with 
i non-root nodes as in Stage 1 we get that the expectation of the number of consistent 
trees X is at most 

2t 2t 

i=t i=t 

Thus the expectation is < 1/3 if t = 0(e^^'°^) is picked large enough. Markov's 
inequality proves that with probability at least | no tree in Y is consistent with a ran- 
domly chosen table. We efficiently construct such a table using the method of conditional 
expectations in the following algorithm: 

TABLE CREATION ALGORITHM 

• For all X = 1 to ra, For all y = to 2t 

• Set T{x,y) = 1/2 

• For all X = 1 to n, For all y = to 2t 

• Set T{x,y) = 
For all r G y 

• Compute Pr,o = UveriUideihekv) co\oT{t) + nielabel(.)(l " color(z))) 

• (Here color(z) corresponds to the entry from T that is assigned to this 
number i in the label of node v when the coloring of r is guided by T. 
Note that p^-fi corresponds exactly to the probability that every node-label 
in T becomes monochromatic if colors are filled in from the table T into 
T level-by- level from leaf-to-root while choosing a random color instead of 
any 1/2.) 

Let Eo = Y.T<^Y Pr,o 

• set T{x,y) = 1 and compute all p^^i and Ei similarly to the last step 

• ii Eq < El than T{x, y) = else T{x, y) = 1 in order to minimize the expecta- 
tion. 

END OF TABLE CREATION ALGORITHM 

For the analysis of the table creation we see that Eq and Ei are exactly the expected 
number of consistent trees in Y if we set T{x,y) to or 1 respectively. Because of our 
choice of t from above we get that in the beginning this expectation is E = ^o+Ei ^ 2/3. 
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By always choosing the color that minimizes this expectation the invariant ^'^^^^ < 2/3 
is preserved throughout the algorithm. When finally all entries of T are chosen, no 
randomness remains and the invariant implies that no tree with properties 1-5 is consistent 
with T. This stage of the algorithm takes 0{4tk\Y\) time for each of the 2tn iterations 
and therefore runs in time polynomial in n. 

Stage 3: Run a Recoloring Algorithm using Colors from the Table 

1. Initially color [n] using the first column of T. 

2. WHILE there is a monochromatic k-AP E 

recolor the numbers in E using for each number its next unused color from T 

This completes the algorithm. In the rest of this section we show that the algorithm 
terminates without requesting more than t colors for one number which will be enough 
to argue a quick termination. Note that because of the termination condition of the 
algorithm no proof of correctness is needed. 

Claim: Each number gets recolored at most t times. 
Proof of Claim 

Lets look at the sequence of k-APs as picked by the algorithm. For each k-AP E in 
this sequence and each subset S* of ii^ we construct a tree labeled by subsets of [n] by 
starting with a root with label S. Going back in the sequence we iteratively take the next 
k-AP B and if there is a node in the tree whose label shares a number with B we create 
a new node with label B and attach it to the lowest such node breaking ties arbitrarily. 

Let Z be the set of trees that can be constructed from the run of the algorithm using 
the table T. We prove the claim in the following two steps: 

1. All trees in Z are consistent with the table T. 

2. If a number got recolored more than t times then there exists a tree r G F fl Z 
which leads to the desired contradiction. 

All trees in Z are consistent with the table T: 

We want to argue that the colors that gets filled from T into a k-AP E when consistency 
is checked are exactly the same entries in T that the algorithm sees before it recolors this 
k-AP E, i.e., both are monochromatic. Focusing on one number x G -E we directly see 
that the entry from T that is used to recolor x is the entry with the number i from the 
column in T that belongs to x, where i is the number of times a color for x was needed 
before which is exactly one plus the number of k-APs containing x that got recolored 
before. Note that all these k-APs appear in a tree below E which is the reason why 
when consistency is checked for also exactly the entry i is filled into x (see definition 
of consistency). This proves that any tree that got created from a run with table T is 
consistent with T. 

If a number got recolored more than t times then a tree r eY is constructed: 
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For sake of contradiction we assume that a number got recolored more than t times 
and argue that in this case a tree r ^ Y gets constructed. Note that by construction all 
trees fulfill the properties 1-4. Hence it remains that a tree of size between t and 2t is 
generated from the trace. For this let r be the the smallest tree in Z of size s > t. Such 
a tree exists because generating a tree from the t*^ time a number got recolored produces 
a tree of size at least t. If the label S of the root of r consists of just one number then 
because of property 3 and 4 it has only one child and the tree generated choosing this 
child as a root label has size s — 1. Otherwise take one number x & S and look at the 
trees generated with {x} and S — {x} as a root label. One of them has size at least s/2 
since each node in the tree generated by S appears in at least one of the new trees. In 
either case the minimality of r - that the remaining tree of size either s — 1 or s/2 has to 
be smaller than t - implies s < 2t. This shows that the tree r that is constructed from 
the trace fulfills all 5 properties and is therefore a tree from Y that is consistent with the 
table T. This is a contradiction to the way we constructed the table T in stage 2. 
End of Proof of Claim 

It is easy to see that with the guarantee given by this claim the algorithm runs for at 
most 0{tn) time in this stage and terminates with a proper coloring. With all previous 
stages running in time polynomial in n the entire algorithm does so and thus fulfills the 
properties of a deterministic-constructive proof, finishing the proof of Theorem 17. 1[ | 



Corollary 7.2 W{k, 2) > ^-^ 1 by a randomized- constructive proof. 

Proof: The algorithm used to achieve this bound is simply stage 3 of the algorithm 
above but instead of using the colors from a carefully prepared table T an independent 
uniformly random color is chosen each time a new color is needed. If more than t new 
colors are requested for any number the algorithm stops and reports its failure. This is 
the randomized algorithm of Moser and Tardos [18j which is very similar and actually 
encompasses Moser's algorithm given in Section [61 For its analysis we note that the only 
reason why Theorem 17.11 does not give us the bound of this theorem is because we can 
not make e smaller with k. The reason for this is that the running time of stage 1 and 
2 is n'^^'^ ^ time which forces e to be a fixed constant. Since the randomized algorithm 
only runs stage 3 we can choose e = Q{:;^) where n' = ^ ^^ such that 2^^''~^^'' > e~" > 
(1 — 1/n'). This still keeps the running time of stage 3 to be polynomial, more specifically 
0{tn) = 0(ne^'°^) = 0(n(n'/c)^'°^). The success probability comes directly from the 
analysis for stage 2. There is already stated that the probability for random colors to 
form a good table is at least 2/3. Thus also the success probability of the described 
algorithm to reports a proper 2-coloring is as required by the definition of randomized- 
constructive. With such a small e the lower bound implied by this randomized algorithm 
now becomes W{k, 2) > - — ^ — - > ^ ^^ (1 — 1/n') = ^-^ 1 as desired. | 
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